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Abstract 

In this research, we develop a trading strategy for the discrete-time optimal 
liquidation problem of large order trading with different market microstruc¬ 
tures in an illiquid market. In this framework, the flow of orders can be 
viewed as a point process with stochastic intensity. We model the price im¬ 
pact as a linear function of a self-exciting dynamic process. We formulate 
the liquidation problem as a discrete-time Markov Decision Processes, where 
the state process is a Piecewise Deterministic Markov Process (PDMP). The 
numerical results indicate that an optimal trading strategy is dependent on 
characteristics of the market microstructure. When no orders above certain 
value come the optimal solution takes offers in the lower levels of the limit 
order book in order to prevent not filling of orders and facing final inventory 
costs. 
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1. Introduction 


In an illiquid market, due to lack of counterparties and uncertainty about 
the assets’ value, trading of assets by fair value is not guaranteed. In a 
market like this, a trader faces liquidity restrictions, and behaves differently 
in comparison to an unconstrained market. Depending on the elasticity of 
the market, the effect of an increased offer will be compensated by a drop 
in prices. Effectively, the initial price impact partially is temporary, and 
vanishes after the execution of the order depending on the elasticity of the 
market. Early liquidation causes an unfavorable influence on the stock price, 
and a late execution has liquidity risk since the stock price can move away 
from that at the beginning of the period. 

Most practitioners deal with this dilemma by predicting the trend of stock 
price and adjusting their order execution speed. While the stock price starts 
to go down, they send positive signals to market by decreasing rapidly the 
size of order; otherwise, they should wait until the end of execution period 
when the position becomes urgent to liquidate. In such a situation, when 
they expect the stock price starts to rise, they split orders and execute with 
offers in deeper levels in the order book to gain an advantage from increas¬ 
ing stock prices. Liquidation of large block orders has an impact on market 
resilience and market depth. Lack of transparency in a market and splitting 
trade share help larger traders to avoid reorganization by other participants, 
who can move against them. 

In this research, we determine the optimal liquidation strategy of a single 
trader, who wants to liquidate a large portfolio in an illiquid market. We 
formulate the liquidation problem as a multi-stopping problem with Poisson 
arrival patterns of order in a discrete-time model. We set up a stochastic 
control framework to maximize the expected revenue of trading in the entire 
execution time taking into consideration the liquidity restriction of trading a 
large order. The assumption of the discrete-time framework is not far from 
the classical trading algorithms. In most continuous liquidation problem 
setups, it is assumed that supply and demand are in balance; this is only 
possible in a liquid market. We show how the current state of the arrival 
rates of limit orders in the order book can be used to compute price impact 
in terms of the conditional distribution of price changes. 
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The optimal liquidation problem can be defined as an optimal control 
problem to determine optimal strategies for trading stock portfolios by min¬ 
imizing the entire cost function. These strategies depend on the state of the 
market as well as price and size of stocks available during the execution of 
the limit orders. To find an optimal solution, we need to consider a trade-off 
between liquidity risk and changing the stock price. The former resulting 
in in slow order execution and latter caused by exogenous events or a rapid 
liquidation. Optimal liquidation problems seeks optimal strategies for trad¬ 
ing stock with regards to both liquidity risks and non-execution risks. These 
risks are attributable to liquidity restrictions and time delay of execution 
orders. 

The study of the optimal execution problem dates back to 1990’s, and 
mainly focuses on the discrete-time models that optimal strategies are deter¬ 
mined as optimal liquidation rates per unit time. Bertsimas and Lo (1998) 
studied the optimal liquidation of a large block of shares with linear per¬ 
manent price impact in a fixed time horizon. Almgren and Chriss (2001) 
as one of the most cited optimal execution models, used a diffusion price 
process in a continuous-time trading space. They constructed an efficient 
frontier of execution strategies via mean-variance analysis of expected costs 
of liquidation and divided the price impact into temporary and/or linear per¬ 
manent impact. From a traditional view point on this problem (e.g. (Alfonsi 
and Scliied, 2010), and (Alfonsi et ah, 2010)), the optimal liquidation de¬ 
pends on existence of a sufficiently large limit order in the limit order book, 
and price impact is a function of the shape and depth of the limit order book. 

Bayraktar and Ludkovski (2014) formulated the liquidation problem as 
a Hamilton Jacobi Bellman equation association with the depth function of 
the limit order book. A recent study by Horst and Naujokat (2014) addressed 
the problem of optimal trading in illiquid markets. They studied a trading 
algorithm with a two-sided limit order market as well as market orders in 
a dark pool by controlling the bid-ask spread. Their algorithm determined 
the optimal time of crossing the bid-ask spread which is a primary problem 
of algorithmic trading. Under the same market condition, Horst and Nau¬ 
jokat (2011) studied optimal trading problems in an option market. In their 
mathematical framework, risk-neutral and risk averse investors hold Euro¬ 
pean contingent claims and the price evolution of the underlying is affected 
by agents’ trading. They proved the existence and uniqueness of equilibrium 
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for a number of interacting players of the market. 

An optimal stopping problem is a link between the control theory and 
market microstructure. This problem has been studied as a single or multi¬ 
stopping problem in the classical house selling problems or best choice prob¬ 
lems by using homogeneous Poisson processes. Single stopping time problem 
governed with Poisson Process was formulated as a best choice problem in the 
late 1950’s by Lindley (1961). The optimal k-stopping problem with finite 
and infinite time horizon was presented with the complete solution by Peskir 
and Shiryaev (2006) in a Bayesian formulation. A similar problem, which has 
been considered in the market microstructure literature by (Garman, 1976), 
studied a trading problem of a market maker who maximizes her profit by 
assuming order arrival rates depending on the price dynamics governed by 
the Poisson process. Smith et al. (2003) simulated the buy and sell order 
with thr Poisson process in which the arrival rates are independent of the 
state of the order book. Recent study by (Cont et ah, 2010) used Laplace 
transforms to analyze the behavior of the order-book with Poisson arrivals 
of buy and sell orders. 

The homogeneous Poisson Process of sell and buy orders arrival rate was 
the main assumption of past studies. Garman (1976) explained conditions 
necessary and sufficient for the order arrival patterns to be modeled by a ho¬ 
mogeneous Poisson processor. In this framework, none of the agents’ trading 
can dominate other agents or they place a large number of limit orders in 
a finite time. Nevertheless, most of these assumptions are violated in the 
high-frequency trading. Empirical studies of high-frequency data show that 
there are significant cross-correlation patterns of the arrival rate of similar 
limit buy or sell orders and significant autocorrelation in durations of events, 
(see: Cont (2011)). 

Some empirical studies like Bacry et al. (2013) showed that high frequency 
data can be modeled by Hawkes processes, introduced by HAWKES (1971). 
The irregularity properties of high frequency financial data can be explained 
by self-exciting and mutually-exciting properties of the Hawkes processes. 
Engle and Lunde (2003) modeled trade and quote arrivals with bivariate 
point processes. 

In the illiquid market, the disparity between supply and demand causes 
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illiquidity, which means the executing larger positions need longer time. We 
formulate the liquidation problem as a discrete-time Markov Decision Pro¬ 
cesses (MDP) where the state process is a Piecewise Deterministic Markov 
Process (PDMP), which is a member of right continuous Markov Process 
family introduced by Davis (1984). By applying a MDP approach, we decom¬ 
pose the liquidation problem as a continuous-time stochastic control problem 
into multiplies deterministic optimal control problems and construct an ap¬ 
proximation of value function with a quantization method proposed by Bally 
et al. (2003). In our numerical simulation, we compare the performance of 
our algorithm with regard to various market characteristics and price impact 
functions. 

The numerical results show that the trading strategy is dependent on the 
characteristics of market microstructure and dynamics of incoming orders. In 
the case of favorite offers are not coming, our algorithm will reduce the speed 
of trading and allows the trader to go deeper into limit order book to avoid 
not filling of orders and facing an ultimate inventory penalty. The simulated 
results indicate that higher probability of same types of orders’ occurrences 
(self-exciting property of the point process), creates more profitable trading 
opportunities. 

The remainder of this paper is organized as follows. Section 2 describes 
the statistical model of order book. Section 3 explains the market model 
setup and present the problem statement. Section 4 presents the stochastic 
dynamic of the intensity of the order arrival process. In section 5, we turn 
to model price impact. Section 6 describes the procedure of solution with 
using discrete-time Markov Process. In section 7, we explain the numerical 
method for optimal stopping time and simulate with different micromarket 
structures. Section 8 summarizes the results, and concludes the paper with 
further remarks. 

2. Statistics Model of Limit Order Book 

To understand the behavior of market participants, we need to analyze 
the stochastic fluctuation of stock price and the reaction of players in the 
market. These fluctuations can be explained by a sequence of equilibria of 
demand and supply in the market. In order-driven markets, buy and sell or¬ 
ders arrive at different time points and wait in the LOB (Limit Order Book) 
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to be traded. The limit order book contains information about orders like 
quantity, price and type of orders. This information can be used to reduce 
the complexity of the relation between price fluctuations and limit order book 
dynamic. It also help to predict different market’s quantities conditional on 
the current state of the order book. On other hand, this Information might 
be used against counter-parties to take advantage of price movement. The 
idea of the dark pool to reduce the information linkage and adverse price risk. 

Cont et al. (2010) shows that this information contains short-term price 
movements and might change quickly during the trading period. In illiquid 
markets, the relation between limit order book dynamics and the price be¬ 
havior shows that the less liquid assets wait for a longer time to be executed. 
Therefore queue type models can be applied to analyze the orders arrival 
in the limit order book. Cont et al. (2010) developed a tractable stochastic 
model of limit order markets to capture the main statistical features of limit 
order books. 

The statistical characteristics of the limit order book are well-documented 
by Smith et al. (2003). Garman (1976), Bayraktar et al. (2007) studied the 
fluctuation of the orders arrival in the electronic trading market. Some stud¬ 
ies explained the unconditional and steady-state distributions of the order 
book while Cont et al. (2010) showed the short-term price movements could 
be explained by the information on the current state of the limit order book. 
Their model is based on the dynamics of the best bid and offer queues since 
the best orders can move the price. 

Underlying our approach is that the dynamics of limit orders arrivals fol¬ 
low a Poisson pattern of prices depending on rates of trading. We study the 
stochastic dynamics of the arrival rate of limit order with the help of order 
statistics. 


Distribution of a limit order book 

We assume in a financial market, the price processes (S^)^j = i...d) of limit 
orders satisfy the following stochastic dynamic in a finite discrete-time hori¬ 
zon t e r = {1 < Ti ■■■< T m < n }: 

S’ =Si( n dt + dC{), ( 2 . 1 ) 
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where C t = Y^n=i and J n is an independent and identically distributed 
random variable and N t counting process. 

Given a vector of price of buy (sell) orders (<S't)i<j<d on the probability space 
(0; T\ P), the orders are sorted into a vector (S^, S^ 2 \ • • •, S^) satisfy: 


(S< 1) <S, (2> ,...,<S®) 

The vector (Sf, 5, , ■ ■ ■, S /' j is a so-cailed vector of order statistics of the 
price processes (Sj). 

Let L be the number of unexecuted orders at the time point s. In the 
time interval (s, t), the rate of arrival of limit orders is governed by a Poisson 
process. It is assumed that noisy traders cannot have a strong influence on 
the market, and no cancellation or strategic cancellation of orders can occur. 
Hence, this model is a pure birth Poisson process with intensity A, and the 
arrivals of orders in the non-overlapping intervals are independent. 

In a small time interval dt , the probability that a limit order arrives and 
sits in the limit order book is: 

P(N(dt) = 1) = >f e ~ Xdt = Xdt + 0(dt ) 

Similarly, the probability that no limit order appears in the limit order book 
in this interval is: 


P(N(dt) = 0) = e~ Xdt = 1 - A dt + 0{dt) 
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Figure 1: Orders’ arrival governed by Poisson process 


Theorem 1 (Distribution of the limit order book). Denote by L the 
number of unexecuted orders at time s. We assume that in the interval (0, t), 
the number of orders (N t ) is a random variable with the Poisson distribution 
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with mean value Xt. Vector {S'*, • • •, S^} represents the prices of buy (sell) 
orders with distribution F(S ) on the probability space (fi; JqP). U is the 
number of unexecuted orders with prices greater than Y = max{S*, • • •, S 1 Nt ], 
then the probability of having k unexecuted orders with prices greater than Y 
is: 


P(U = k\N s = L ) 


e~ Av ■ Ay 
k\ 


where 


\y = A[1 - F(Y)t - ln(e AF < i ‘> - W2_)]. 

(Proof is given in the appendix) 

With given k = 0 , equation 2.2 gives the probability of best orders (i.e. none 
of orders with price (S l t )i & { has greater price than Y), with k = 1 gives 
the probability of the second best order,and so on. 

3. Market Model Setup 

ft is assumed that our financial market consists of an illiquid asset, it 
can be considered as a risky asset, and a risk-free asset as a numeraire with 
the interest rate r. The market for the risk-free asset is liquid, that means 
traders can liquidate a large amount of this security without facing costs of 
price impact. 

In a complete financial market with a finite discrete-time horizon r = 
{1 < Ti • ■ • < T m < n}, the price process S t is a stochastic process on a com¬ 
plete filtered probability space (hi; J-\ F; P) where F is the filtration generated 
by {J-tjtgr. This space is bounded by a maturity time T. 

The assumption of the finite discrete-time space is contradiction to con¬ 
ventional liquidation problems. However, it is not far away from reality; 
order arrival patterns of buy and sell orders are not the same. Because of the 
fluctuation in the stock market, especially in a high-frequency environment, 
orders might not appear regularly in the LOB. Some empirical studies show 
that in a short period of time, the percentage changes of the stock price are 




not uniformly distributed with same centrality, but price process can be in¬ 
ternally steady state processes. Therefore, the model should be solved and 
interpreted in the discrete time and space. We use these facts and propose a 
model with the rate of incoming buy orders as a Poisson process in a finite 
discrete-time and space. 


3.1. Trading Boundaries 

Traders often follow trends of the prices and construct trading bound¬ 
aries built in on market depth. They submit limit orders at touch with an 
optimum volume when the stock prices hit one of these trading boundaries. 
Market depth reflects the information related to the prices of buy and sell 
orders for the price and depends on trade volume, and minimum price incre¬ 
ment known as tick size. It is constantly changing, and reflects the valuable 
information about the current orders sitting in the limit order book. Know¬ 
ing this information helps traders to understand hidden patterns of price 
movements and price impact. Traders can use this potential information, 
and regulate their orders in response to the net order flow. 

Cont et al. (2014) studied the link between price impact and market depth 
and showed that there is a linear relationship between an orders flow imbal¬ 
ance and price changes in high-frequency markets. Kernpf and Korn (1999) 
measured the market depth as a surplus demand amount that is needed for 
the jumping of one unit price. They also showed that the price is sensitive 
to change from counterparties’ demand. They concluded that there is a non¬ 
linear relation between market depth and price impact of the orders flow. 
Bessembinder and Seguin (1993) studied price, trading volume, and market 
depth in futures markets, and showed that the price impact has negative 
relationships to liquidity, i.e. liquidity provisions decrease during trading ac¬ 
tivities in an illiquid market. 

Market depth gives the overall picture of market conditions and a short 
term prediction to determine an optimum strategy, e.g. price movement 
towards selling pressure or buying strength in the short time, especially in 
illiquid markets. Some platforms apply a number of restrictions for market 
participants to observe or trade at the best level; we assume all orders are 
observable and accessible for traders. Market depth can be affected by the 
transparency of markets in such away that some levels are hidden, and just 
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Figure 2: Schematic model of trading boundaries built on market depth with 
Poisson arrival patterns 


latest submitted orders are available. Limiting trading and adjusting mini¬ 
mum price increment, known as the tick size are important mechanisms to 
improve the efficiency of the market. 

In illiquid markets, lower price levels of market depth are more attractive 
than upper levels; these depth levels include orders with significantly larger 
volumes. Most optimal liquidation methods focus on the best sell and buy 
price levels since their imbalance can move prices. By cause of the lack of 
available liquidity, we need to take the lower level of market depth into ac¬ 
count. We will show how to explain the dynamic of different levels of market 
depth with Point processes. 


3.2. Problem statement 

The dynamics of the price is described by a right-continuous process 
(St)(t> o) changing while the times when the book order process meets bound¬ 
ary conditions. Later on, we will discuss the impact of the current trade on 
the underlying price by using a particular approach to model price impact 
based on exogenous factors as well as characteristics of the stock price pro¬ 
cesses. We will show how to model the dynamics of the intensity of orders 
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arrival corresponding feedback effects of trading and the state of the market 
during orders execution period. 

We consider a discrete-time problem for an investor holding a large volume 
(Q°) shares of illiquid assets and a risk-free asset. The objective of the 
shareholder is to maximize her profit with subject to liquidity constraints 
and a limited execution time. 

The illiquid asset, also can be considered a risky asset with the following 
dynamic in a finite discrete-time horizon r = {0 < Tj • • • < T m < n}: 

dS t = S°(fi t dt + crtWt ) t e r 

and a risk-free asset used as a numeraire with the interest rate r with the 
following dynamic: 


dB t = B°e rt 


Let S = e~ rt S t be a martingale with respect to the measure P on a complete 
filtered probability space(f2; T\ P). 

The trading strategy of the trader is characterized by a trading rate 
. The vector 7 contains the information on the amount of trading at each 
time point t. 

The dynamics of the inventory of the investor holding Q° shares of an illiquid 
asset with the trading rate 7 as a control process is given with the following 
counting process: 


dqP = - A 7 t dNf 

where the A is a fraction of Q° shares, assumed to be constant at each 
stopping time i.e. either we fill whole orders or reject offers. This assumption 
can be questionable, but from the theoretical point of view, it reduces the 
complexity of the problem. Let N t be a counting process, and F t be a cash 
flow process with dynamics: 

dFP = S t A lt dN? 

The investor has a finite time to liquidate her risky assets and maximize her 
wealth: 
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sup [W T ) 

76 *(Q°) 

where Wr is the amount of the cash at the end of time horizon T. We define 
^(Q 0 ) as a set of admissible strategies with given initial inventory with Q° 
shares to have nonnegative inventory at all times: 


A(Q°) = {7 : 7 is a predictable process, and 
admissible strategy from the initial inventory Q 0 } 

We shall use A = A(Q°) for the set of admissible strategies 7 . 

The liquidation problem can be formulated as a multi-stopping prob¬ 
lem with discrete time sequences {T 1; • • •, T n }. The trader can liquidate her 
shares in the m stops 1 < < • • • < T m < n with a discrete limit order 

book. The goal is to maximize the expected gain at each stopping sequence 
Ti (i < m). The interaction between price impact and price dynamics that 
makes the execution-cost control a dynamic optimization problem. We ap¬ 
ply the Bellman’s optimality equation in a recursive format to solve the 
m-stopping problem. 

max [Expected Revenue] = max [Immediate Exercise 

+ Continuation] 

The trader holds Q° number of shares and places a selling order an k = 
A 7 illiquid asset in the market with the trading rate 7 in the time horizon 
T, the performance criteria with the strategy 7 is given by: 

H^(t,Q°) = [h^(t,k) + E tiq [H^(t+l),Q°-k]} 
with a boundary condition: /r(T, 0) = /r(0,<5°) = 0. 

At the stopping time, when one of these expected boundaries (see figure 2 )is 
hit by the stock price, we execute some proportion of the inventory via limit 
order at the LOB with the depth function h(t,k ): 

h(t,k) = max[(S (tjfc) -ES^O)] 

= («5( t ,fc) — EW( tifc )) + 
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where: 




i=n-k -\-1 


E S m = Y, P ^<k)S? 

i=n—k+l 

Let E S(t,k) be the expected boundaries, constructed from the set of best 
limit orders in the LOB by using the distribution of the order book at the 
stopping time t. 

The goal of the investor is to maximize her wealth at end of the time 
period T associated to this dynamic problem, the value function can be 
defined by: 

V(t,q) = sup E t , q [H^(t, q)}, ter, qe[0,Q°]. 

'yeA 

The terminal wealth value function of the investor who maximizes her wealth 
at the end of time period T and give discounted price process S, and inven¬ 
tory Q 0 , associated to optimal trading rate 7 , can be expressed with the 
following lemma: 


Lemma 2. Let V(T,Q°) be the continuation value that is obtained from 
optimal trading of Q° shares until the end of period T and the intensity 
process \ t be defined as a rate of arrival of limit orders. The expected revenue 
from execution of limit orders with arrival patterns with Poisson distribution 
is equal to: 

V(T, Q°) = su P E t , ? [ [ e~ rr A lt S t X t dt], 

7 6.4 Jo 

where T' = T A inf {A > 0 : Q° — q t = 0} is trading time and trading process 
is a control process, which has influence over the cash process, the inventory 
process, and the dynamics of prices. 

(Proof is given in the appendix) 
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4. Modeling Stochastic Intensity 

The rate of arrival of limit orders depends on the price and size of orders; 
the cheaper orders will be remained for a shorter time on the limit order 
book. It is empirically shown that the distribution of the price is not con¬ 
stant and depends on the current state of the limit order book. The existence 
of significant autocorrelation of price movement and correlations across time 
periods rejects the natural assumption of a constant intensity of order ar¬ 
rivals rate (see. e.g., : Cont (2011)). 

In an illiquid market, bid and ask orders do not arrive consistently, and 
counterparties do not meet their demands regularly. These irregular propri¬ 
eties of a high-frequency environment lead to applying point process to model 
time series of bid or ask price movements. Avellaneda and Stoikov (2008) 
and Garman (1976) proposed models which order arrivals are governed by 
a point process with constant intensity. There are several conditions in pre¬ 
vious trading models that do not hold our setting. Firstly, a small number 
of traders cannot dominate the market with a large-scaled orders. Second 
condition is the submitting of orders are independent and mainly we have 
a assumption of efficiency of the market. These conditions are essential to 
have a constant intensity of order arrivals. However, the structure of the 
market is dynamic, and high-frequency traders dominate over seventy per¬ 
cents of the market; therefore, none of these above conditions can be satisfied. 

Hawkes process as a point process introduced by HAWKES (1971), was 
initially is applied to model earthquake occurrences. Some recent empirical 
studies show that Hawkes process can fit with high-frequency data to explain 
its irregularity properties based on the positive and negative jumping behav¬ 
ior of the asset prices. Cartea et al. (2014b) used the Hawkes processes to 
express the dynamics of market orders, the limit order book as well as effects 
of adverse selection. This process is a general form of a standard point pro¬ 
cess, the intensity is conditional on the recent history, are increase the rate of 
arrival the same type event (Self-exciting property), and it captures the im¬ 
pact of arrivals of orders on other type of orders (Mutually-exciting property). 

The concept of a point process is fundamental to the stochastic process. 
Before we explain the dynamic of the Hawkes process, we state the following 
formal definition of a point process, a counting process and an intensity 
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process: 


Definition 1. Point Process : 

Let ti (i E N) be a sequence of non-negative random variables, which is 
measurable on the probability space (f2; T\ P), in such a way that \/i G N, U < 
ti+i, is defined as a point process on M. 

Definition 2. Counting Process : 

The right-continuous process N(t ) = ^T gAr ^-U<t ,with given a point process L 
(i E N), is a so-called counting process if it measures the number of discrete 
events up and including the time point t. 

Definition 3. Intensity Process : 

With given N t as a point process adapted to a filtration T , the intensity 
process X as a left-continuous process is defined by: 


A(<|J=V) = Nt \7 t ] (4.1) 

= lim P-t[AT, Ar.ljy (4.2) 

At->0 At 

To be more precise, a intensity process X t is determined by a counting 
process N t with the following probabilities: 

P(7V t+At - N t = 1 ) = XAt + O(At) (4.3) 

F{N t+At - N t = 0) = l-XAt + 0(At) (4.4) 

nN t+At - N t > 1) = 0(At) (4.5) 


Homogeneous Poisson process is a so-called intensity process that is in¬ 
dependent of the probability of the occurrence in the small interval At and 
a filtration T t . 

A general form of a linear self-exciting process can be expressed: 

X t = X 0 + f crf(t - s)dN s (4.6) 

J —OO 

where Ao is a deterministic long run ’’base” intensity,which is assumed to 
be constant. The function f(t) expresses the impact of the past events on 
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the current intensity process, and the parameter a explains the magnitude 
of self-exciting and the strength of an incentive to generate the same event. 

As a result of converting the integrated intensity into independent compo¬ 
nents via exponentially distributed variables, we can apply most of analytical 
methods to analyze these statistical random variables. One can calibrate the 
parameters of the Hawkes process with parametric estimation methods like 
maximum likelihood estimation (Ozaki (1979)), or with non-parametric esti¬ 
mators like Expectation-Maximization (EM) algorithm (Bacry et al. (2012)). 
The goodness of the fit of these models also can be examined with conven¬ 
tional statistical tests. 



Endogenous impact 


Exogenous impact 


Figure 3: Hawkes Process with 31 events 


5. Price Impact Model 

Estimating and modeling price impacts is a crucial research in the market 
microstructure literature. It can be expressed as a relationship between trad¬ 
ing activities and price movements. Monitoring and controlling the impact 
of trading are the main part of algorithm trading. To minimize the market 
impact, traders split their orders into smaller chunks based on the current 
liquidity in the limit order book. Price impact might be dependent on ex¬ 
ogenous factors like trade rate and some endogenous factors such as liquidity 


16 








and volatility. It is empirically observed that there is a changing of volatility 
of prices on trading activities. Kyle (1985) proposed a simple model for the 
evolution of market prices and price movement. In his model, noise traders 
and inform traders submit orders and in the each step, and a market maker 
executes the orders. The price is adjusted to a linear relationship between 
the trade size and a proxy for market liquidity. As a consequence of trading, 
price moves permanently, information affect the price for a long time, and 
price changes are strongly autocorrelated. The most recent literature on the 
market microstructure shows that for liquid markets price impact cannot be 
permanent. In highly liquid markets, outstanding shares are small and need 
less time to be liquidated. 

In illiquid markets, the temporary price impact governs the enduring im¬ 
pact, and after a considerable number of trades, the price movement shows 
a high resilience. Empirical studies show that an elastic market can be con¬ 
verted to a plastic (inelastic) market as a consequence of lacking counterpar¬ 
ties, such that high volume trading have a long-lasting impact. In this market 
traders face difficulty to find counterparties at the particular time, and they 
should wait for a longer time to execute the orders or else cooperate with 
counterparties. The effect of price impact corresponding to the liquidation 
strategy can be significantly large for substantial risk aversion traders who 
liquidate shares at a fast rate. Modeling of price impact on illiquid markets 
is not so well studied; we review some different generations of price impact 
modeling in literature. 

We can loosely classify price impact models based on their effects and how 
long they have influence over the dynamics of the prices in four categories: 
The first class is a permanent price impact. As a consequence of a signif¬ 
icant discrepancy between supply and demand in the market and a spread 
of bulk trading information, the dynamic of price have stable shifts. Kyle 
(1985) proposed a basic microstructure model to analyze the price impact. 
Permanent impact was one the component of Bertsimas and Lo (1998) and 
Almgren and Chriss (2001) price model. Empirical researches show that in 
a liquid market trading activities cannot alter the dynamics of the price for 
a long time. Conversely, this component can be one of the basic building 
blocks of price impact models in the illiquid market. 

The second tier of the price impact model is related to modeling the tern- 


17 


porary impacts that just have an effect on the current orders for a short 
time and not for the entire trading time. This component cannot alter the 
dynamics of price for a long period and just has an impact on the immediate 
execution of the trades. The transient impact is a third class of price impact; 
this component can be significant for a finite period, and it eventually vanish 
[Gatheral (2010)]. Alfonsi et al. (2008); Predoiu et al. (2011)) modeled price 
impact by considering this component. 

The last class of the price impact modeling is to control the rate of ar¬ 
rival of limit orders via the trading rate process. Alfonsi and Blanc (2014) 
introduced a mixed market impact Poisson model to analyze a temporary 
shift of dynamics of the rate of order arrival. This model used the advantage 
of the self-exciting property of the Hawkes process to change the direction 
of trading in the same or opposite direction of order arrivals. Bayraktar and 
Ludkovski (2014) and Gueant et ah (2012) controlled the intensity of limit 
orders for the liquidation problem in a risk-neutral and risk averse model, 
respectively. 

In this paper, we introduce a stochastic intensity process to measure the 
price impact of order executions. This model is associated with a counting 
process using the mutual-exciting property of the Hawkes process. In illiquid 
markets, the imbalance between supply and demand causes illiquidity and 
the execution of a larger position need a longer time and affect on the arrival 
of the new orders or stay longer in the limit order book. Also, we explained 
the coming pattern of orders governed by a stochastic point process. There¬ 
fore, the intensity of order arrival is influenced by the arrival time of orders 
and the orders’ value, and indirectly the price, will be affected by trading. 

According to fundamental concepts of economics, in equilibrium, the re¬ 
lationship between supply and demand determines the price that traders 
are willing to take positions during a specified period (see: figure 4). The 
price movement occurs when a change in demand is caused by a change in 
a number of market orders. This change in the price equilibrium is sensitive 
to shifts in both prices, and quantity demanded, which is called the ’’price 
elasticity of demand.” 

We model this impact with close form solutions for the dynamics of price 
impact. Let function /(y t ) be a general form of the impact market, condi¬ 
tional on the state of liquidity of the market. Similar to Kyle (1985) model, 
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Figure 4: Changes in equilibrium price as a result of increasing and decreasing 
of demands 


we use parameter a , as inverse liquidity of the market, to measure price 
impact. Function T(t — s) is the decay of price impact function, which is 
independent of the state of the market. This function can be shown by the 
exponential or power law decay of price impact. 

Different types of price impact and decay functions have been used in 
the algorithm trading and market microstructure literature. We define two 
well-known impact functions: exponential and power law functions, linked to 
the exponential decay function. The parameter a is a proxy for the inverse 
of the market liquidity: 


• Power law impact function: 

/( 7 ) = 7 “, « > 0 

• Exponential impact function: 

fh) = exp(a 7 ), a > 0 

Gatheral (2010) examined the dynamic-arbitrage for different combinations 
of the market impact function and decay function to not admit price ma¬ 
nipulation strategies. (Alfonsi and Schicd (2010), proposition 2 ) proved the 
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convex and non-constant exponential price impact, leads to the strictly posi¬ 
tive definite property, to avoid arbitrage implication, which is already stated 
in Gatheral (2010). Nonlinear impact function that is not a related state of 
the market is questionable; however, above functions defined in an illiquid 
market depend on the state of market. 

Hawkes process 

We model the dynamics of trade arrivals intensity with the Hawkes pro¬ 
cess as a point process. This model can capture irregular properties of the 
high frequency data like the strength of an incentive to generate the same 
event with parameter a. With choosing the price impact function / as a 
function of a trading rate 7 1 and the parameter k as the exponent of the 
decay of market impact, we can model an impact of liquidation of a large 
position on the trade arrival dynamics as a particular form of the Hawkes 
process with the following SDE: 


d\ t = - n\i)dt + odN t 


(5.1) 


In the following proposition, we model the impact of trading on the rate 
of arrivals based on the Hawkes process: 

Proposition 3. Price Impact Model 

Let f be a price impact function and a function of a trading rate 7 1 . a and 
k represent the magnitude of self-exciting and the exponent of the decay of 
market impact, respectively. The solution of the SDE is expressed by: 



(5.2) 


where the function T is the decay of impact, 

(Proof is given in the appendix) 

Lemma 4. The impact stochastic intensity (equation: (.10),) is a general 
function of price impact. It can then measure a instantaneous price impact 
in the short term, and a permanent price impact on the long run. 

(Proof is given in the appendix) 

Assumption 1. Continuity and concavity of the value function 

We assume that the value function V is a continuous and bounded function. 
It is also strictly concave in q, increasing in t and non-negative. The differ¬ 
entiability condition of the value function is not necessary to be satisfied. 
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6 . Solving Model by Discrete-Time MDP 


The liquidation problem .9 is a continuous-time stochastic control prob¬ 
lem. Bayraktar and Ludkovski (2014) formulated this problem as a Hamilton- 
Jacobi Bellman equation, and provided viscosity solutions as closed-form so¬ 
lutions associated with the limit order book model and its depth function. 
The classical stochastic control approach solves nonlinear partial differential 
equations, and it is necessary the differentiability of the value function to 
be satisfied. In contrast, a discrete-time Markov Decision Processes (MDP) 
approach provides a set of optimal policies, condition on the differentiability 
of the value function. Bauerle and Rieder (2009) used this approach and by 
applying dynamic programming principles, proved the existence and unique¬ 
ness of the solution. 

This liquidation problem is a mathematical abstraction of real problems 
in which an investor should make a decision on several stopping times to gain 
certain revenue at each stage. The investor has a finite period to liquidate 
a position, and maximize the total revenue at the end of the period. There¬ 
fore, in this problem with a finite number of sub-periods, a mapping function 
should be applied to compute optimal policies through the limited number 
of steps of the dynamic programming algorithm. 

She must find an equilibrium to minimize the cost of the present exten¬ 
sive trading against the future abandon risk where the overall cost is not 
predictable. This problem can be formulated as a deterministic or stochas¬ 
tic optimal control problem with Markov or semi-Markov decision property 
under different setups. 

Bertsekas and Shreve (1996) distinguished between the stochastic optimal 
control problems from its deterministic form regarding available information. 
In a deterministic optimal control problem, we can specify a set of states and 
policy as a control process in advance. Thereby, a succeeding state is the 
function of the present state and its control process. On the other hand, 
in the stochastic control problem, controlling the succeeding state of the 
system leads to evaluate unforeseen states; therefore control variables that 
are no longer appropriate or have ceased to exist. In this paper, we use a 
Piecewise Deterministic Markov Decision Model (PDMD) to decompose the 
liquidation (problem: .9) as a continuous-time stochastic control problem 
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into discrete-time problems. 


6.1. Solution by PDMP 

Piecewise Deterministic Markov Process (PDMP), introduced by Davis 
(1984), is now largely applied in various areas such as natural science, engi¬ 
neering, optimal control, and finance. The PDMP is a member of the cadlag 
Markov Process family; it is a non-diffusion stochastic dynamic model, with 
a deterministic motion that is punctuated by a random jump process. 

Definition 4. Piecewise Deterministic Markov Process 

A piecewise-deterministic Markov process (PDMP) is a cadlag Markov pro¬ 
cess with deterministic emotion controlled by the random jump at jump time. 

This process is characterized by three measurement quantities. The first 
feature is the transition measure k, which selects the post-jump location. 
The other quantities are deterministic flow motion 0 between jumps and the 
intensity of the random jump A t , defined as Borel measures on the Borel sets 
of the state space E , and the control action space A. 

In the state space E , set ( t , x ) donates the desired process value at the 
jump time point t. In an embedded Markov chain as a discrete-time Markov 
chain, the state of the PDMP process can be defined as a set of components 
of the continuous trajectory Z k = (20, XT k )k=i,-,n where 20 is an increasing 
sequence of the jump time component and X t and Z t are a jump location 
component and a post jump location component, respectively: ( Z t = X, if 
t = t k ). 

This process starts at the state x t , and jumps with the Poisson rate pro¬ 
cess Aj (fixed or time dependent) to the next state or hits the boundary of 
the state space. Stochastic Kernel K(.\x t ,a t ) by measuring the transmission 
probability selects the next location of the jump given the current informa¬ 
tion on state and action. Each Markovian policy is a function of the jump 
time component (20) and the post jump location ( Zt k ) with the following 
condition: 



for t < T, 
for t = T. 


( 6 . 1 ) 
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Figure 5: Iterative Procedure of PDMP 


Figure 5 shows the iterative procedure of the PDMP: starting point of 
the PDMP is A 0 = Z 0 , then A 0 follows the flow (j) until T x to determine 
first jump location Ah = (p(X 0 ). The stochastic Kernel A'(.|0(Ah),.) selects 
the next location of the post-jump Z\ = A'(.|0(A 1 ), .)• Latter, similar to the 
first jump, X t follows the flow (j) until T 2 so X 2 = 4>{Z \). In next step is 
the selection of a location of the post-jump Z 2 = K(.\cp(Zi), •) by using the 
stochastic Kernel K(.\<f>(Zi ),.). This iterative procedure will be continued 
until it hits a boundary of the state space. 

As mentioned earlier , the process of the illiquid asset in a finite discrete¬ 
time horizon r = {0 < T\ ■ ■ ■ < T m < n} is: 

S t = S 0 exp(fitdt + cr t w t )) t E r 

and at time of jump (if t E [Ti,T i+ 1 )) the price process is: 

~ S Ti+1 = S Ti Ji 

where Ji is an independent and identically distributed random variable. 
The price process S t is a so-called piecewise-deterministic Markov process 
(PDMP). 

6.1.1. Markov Process Components 

General speaking, Markov process models, which are not stationary in 
our setup, include a set of the following terms: 
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• Let A be an action space includes the action a t which denotes the 
quantity of shares to be liquidated at time t. 

a t = 7 t A 
t G [0, • • •, T] 

where 7 1 is an admissible strategy which satisfies the condition 71 < ^ 
to have a non-negative inventory. 

• With a given action set A, the set E is defined as a state space, that 
contains the state x of inventory after applying action a. The process 
state X t denotes the amount of not liquidated shares at jump time t. 

X t = Q°- [ q s dNs 

Jo 

= Q° ~ [ 7 S A dNs 

Jo 

• Let K be a stochastic transition kernel from E x A, as a set of all 
state-action, to a set of states E. We measure the probability of the 
next state and action with transition kernel K(.\x t ,a t ) based on the 
transition law at Markov decision model. 

• The reward function R represents the expected gain as a result of ap¬ 
plying the strategy 7 , of each state at the jump point time t\ 

R(t, x, 7 ) = f 7s A S s dNs = f ~f s AS s \ s ds ( 6 . 2 ) 
Jo Jo 

W(X s )dN s (6.3) 

where the function U : (0, 00 ) — > R + is an increasing concave function, 
which represents the preference over a set of limit orders or satisfaction 
of the trader from offers in the market and X s is the process state X t 
represents the amount of not liquidated shares at jump time t. 

• The deterministic flow motion (j) measures the movement of the inven¬ 
tory of investor between two jumps with a given the strategy 77 : 

0%W) = f r]s A dNs (6.4) 

Jo 
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To be more precise on how we can solve the liquidation problem with 
PDMD, we explain the formal expression of deterministic optimal control 
problems, which is well documented in Bertsekas and Shreve (1996). In a 
formal deterministic optimal control problem, x* presents the state of the 
system at stage i and function q is a corresponding control at that stage. 
System equation x i+ i = /(aq, q) is the generating function of next state x i+ i 
from current state x* and its control q. Function g(xi, q(;q)) is the rewarding 
function of state i a associate with function q. 

The total expected revenue after N decision steps is defined by: 

N 

J c (x 0 ) = g c (xi, Ci(xi))} (6.5) 

»=o 

The set C contains all control functions (q)i={o,...,jv}j be. the expected 
total revenue is set of states and corresponding a sequence of Markovian de¬ 
cision controls. 

Let II = { 7 r!, 7 t 2 , • • •, 7 qv} be the sequence of all Markovian decision con¬ 
trols 7 T,;. These decision controls are corresponding to Markovian policy for 
predictable admissible process 7 defined in the set T. Each Markovian policy 
is a function of the jump time component (X*,) and the post jump location 

(ZtJ. 

In the each stage, the reward obtained as a result of sequential Markovian 
decisions after the jump by applying the strategy 7 q is: 

R(Z il 7i i (Z i ))= [ U* (4> s (Xi))dN s (6.6) 

Jo 

The total expected revenue after N steps is defined by: 

N 

**(t,x) =E tjX [J2 R ( z i,M z i))} (6.7) 

i =0 

In the following theory, we explain how the above equation is mathemat¬ 
ically equivalent to our main problem: (.9). 

Theorem 5. Suppose policy set II = { 77,7 r 2 , • • •, 7 Tjv} is a Markovian policy 
set and Z = {Z\ , Z 2 , • • •, Z n } is a set of post jump location of PMDP and 
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R is the reward function (equation: 6.3). Then the value function is the 
expected reward of the PDMP under the Markovian policy II at time point t 
and in the state x: 

V(t, q) = sup^(t : x), ter, qe[0,Q°} 

wen 

where 

N 

^(t, x) = E^ty; R(Zi, 7 Ti{Zi))\. 

i =0 

(Proof is given in the appendix) 

6.2. Uniqueness of solution 

We started to model the optimal liquidation problem as a stochastic con¬ 
trol model (equation 3.1) and used the piecewise-deterministic Markov pro¬ 
cess to find an equivalent deterministic model for this problem. We also 
proved this problem can be constructed as a summation of the sequence of 
state processes and corresponding control processes in the set II. The formu¬ 
lation has been given in the equation 3.1 and is more consistent with dynamic 
programming principle. 

Bertsekas and Shreve (1996) defined the universal measurable mapping T to 
map equation 3.1 from 6.3 as follows: 


T*(f&){x) =H[x,n,V] (6.8) 

Therefore the operator T 77 ” can be decomposed to T n ° ■ 7 -771 ■ T 772 • • ■ 7 -77 " -1 . 
From above definitions, we have: 

vj/Tn _ 'p' Kn (r^ 

— ’ J 7TQ ' j "^1 B # # ’J ^n — k \£j'^n — k 


The mapping T 77 is an universal measurable mapping, let 7 -770 = 0 and k < n, 
(see: Bertsekas and Shreve (1996) (chapter 1) we have: 

\£j n k — '’J-’TTQ'j-'Tri ' ' # — 


In the following theorem, we prove the uniqueness of the solution by applying 
a piecewise-deterministic Markov process model. 
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Theorem 6. Uniqueness of the solution 

Let V(t, q ) be a revenue function and the optimal solution of the liquida¬ 
tion problem is a concave and decreasing function in q and increasing in t. 
Then the solution of the liquidation problem by applying a PMDP model is 
converging to a unique solution. 

(Proof is given in the appendix) 

7. Numerical method and Simulation 

In this section, we apply a simulation method to assist the performance of 
our model under various market microstructures’ characteristics. The trader 
will decide to take a number of offers in the LOB at given prices. The 
optimum trading rate is dependent on the dynamics of orders’ arrival as well 
as time to maturity. We approximate the value function with a quantization 
method. 

7.1. Approximation of the value function 

As we explained before, the solution of the value function V of the op¬ 
timal liquidation problem is obtained by the summing rewards of sequential 
Markovian decisions with corresponding the Markovian policies n and a set 
of post jump process of the PMDP: 


supE t) q[D(f + 1 ,Q° - q) + h(t,q )] 

■yeA 

OO 

sup E t> 9 [V' R(Zi, 7 Ti(Zi))l T . <T + h(t, q)l Ti >T] 

^ A i=0 

We approximate the value function V with the function V, such that \V — 
V\ l p is minimized for the Lp norm. To approximate the continuous state 
space by a discrete space, we use a technique that is called Quantization 
method. Bally et al. (2003) and Bally et al. (2005) developed quantization 
methods to compute the approximation of a value function of the optimal 
stochastic control. De Saporta et ah (2010) explained the implication of 
the numerical solution to PMDP, such that transmission function cannot be 
computed explicitly from local characteristics of PMDP. De Saporta et ah 
(2010) expressed a numerical solution for Embedded Markov chain, while 


V(t,Q°) = 
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the only source of randomness is a set of the post jump process (T n , Z n ). By 
quantization of Z n = (Xr n ; T n ), we can transfer the conditional expectations 
into hnite sums, and least upper bound of the value function (sup) into its 
maximum value (max) in discretized space of [0, T]. We define V as an 
approximation of the value function as follows: 

OO 

V(t,Q°) = maxE M [V'i?(Zj,7Tj(Zj))ly.< T + h(t,q)lf >T ] 

i =o 

De Saporta et al. (2010) estimated the error and the convergence rate of 
the approximated value function with Lipschitz assumption of local charac¬ 
teristics of PMDP, and showed it is bounded by the constant rate of quanti¬ 
zation error Qe. 

\V(t,Q°) — V(t,Q°)\< Qe (7.1) 


1.2. Simulation 

Conditional expectation of value function can be computed with some 
numerical methods in hnite dimensional space, such as regression method 
Longstaff and Schwartz (2001) or on Malliavin calculus (as in Cont and 
Fournie (2010)). Bally et al. (2003) proposed a quantization method to 
approximate the state space of problem; from each time step T k , a sate 
function Z can be projected to the grid T k := {z T i}i<i< N (see: figure 6) 

Z Tk = z T il T i eB k (7.2) 

1 <i<N 

where B\ is a Borel partition of (see: Bally et al. (2003)). 

As previously stated, at each stage, the reward obtained for each stage of 
sequential Markovian decision after a jump by applying strategy 7q is: 


V k = R(Z Tk ,n(Z Tk )) (7.3) 

By applying dynamic programming principle for n fixed grids T 0 <fc< n , V k 
satisfies the backward dynamic programming condition: 


V n = R(Z T „,n(Z T J) 


(7.4) 



0 0.2 0.4 0.6 0.8 1 


Figure 6 : Quantization of state space (Z tl T { ) 


V k = max( J R(Z Tj ,, 7 r(Z T J,E(T 4 + i|Z T J) (7.5) 

We have used a particular SDE form of the Hawkes process of the intensity 
of the rate of order arrivals to express the impact of order execution on the 
market: 


d\ t = (/( 7 t) - n\ t )dt + crdN t (7.6) 

where f{p/t) is a function of trade rate 7 1 , cr explained the strength of the 
incentive to generate the same event , and k is the exponent of the decay of 
market impact. 

The Hawkes process can capture both exogenous impacts and endoge¬ 
nous influence of past events to measure the probability of occurrences of 
events. This intensity is based on modeling with (er > 0 ) to capture the 
contribution of past events to amplify the chance of an occurrence of the 
same type of events (Self-exciting property of the Hawkes process). By us¬ 
ing this endogenous mechanism, (while a < 0 ), the model can explain the 
significant aspect of the strategic function of market participants known as 
a ’’market manipulation” (see:, e.g., Cartea et al. (2014b)). ft is often used 
by traders to submit or cancel orders strategically to detect hidden liquidity 
or to manipulate markets. 
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If trading activity with reducing possibility occurrence has an adverse 
influence on the arrival of orders, the jump process has an adverse impact 
on its intensity and makes imbalance in supply and demand of the market 
exponentially. This damping factor can be measured with Hawkes model 
the magnitude of self-exciting and the strength of the incentive while it is 
negative (self-damping property). 

7.3. Result of Simulation 

In this part, we present the numerical solution of the optimal liquida¬ 
tion problem. To study characteristics of the value function and the level of 
inventory associated with the control variable 7 as the rate of trading, we 
compute some numerical examples using different scenarios from empirical 
studies. Our simulation is an abstract of real problems. We consider a trader 
who wants to liquidate Q° shares of a risky asset within a short time and 
fixed time horizon T. In an illiquid market, she expects a longer time to liq¬ 
uidate the whole position. Her goal is to minimize the implicit and explicit 
cost of trading and keep the low-level inventory by controlling the trading 
rate. 

We implement our model in the discrete state space. We choose time 
steps small enough to increase the chance to catch orders and larger than 
the usual tick time to make sure that quotes are not outside of the market 
bid-ask spreads. We assess the performance of our model by quantizing the 
value function at a fixed position in the space and time of the mesh refine¬ 
ment. 

To illustrate in more detail how our model behaves, we study the inven¬ 
tory level associated with the optimal trading rate control for both types 
of price impact Hawkes models: self-damping and self-exciting properties. 
Concerning our simulation scenarios, we choose values of the parameters of 
the model: (a) the parameter a as the magnitude of self-exciting, (b) the 
parameter n as the exponent of the decay of market impact and (c) the size 
of the bid-ask spread is used as a proxy to measure the illiquidity. These 
parameters can be estimated from the real market data. 

Plotting the trading boundaries (figure 8 ) shows that the optimal trading 
level depends on the price process, the remainder of the inventory, and time 
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to maturity. 


Due to market’s conditions and asset’s characteristics, an agent with the 
higher degree of risk aversion, cares more about the execution risk and price 
fluctuations. She starts the trading with available orders at a deeper level of 
the limit order book to avoid the risk execution and lack of offers in the future. 
She splits the original order into smaller slices to mitigate price impacts. 


x io 4 Inventory level of investor with given initial inventory Q and Time to maturity T 




(a) 


(b) 


Figure 7: (a): Inventory level of a trader with given the initial inventory 
Q° and time to maturity T, (b): Trading rate of liquidation problem with 
constant order size A 


Table 1 summarizes results of simulations by our model, including the level 
of inventory and its corresponding optimal trading rate for different scenarios 
of implementations of strategies. In the case of coming of not favorite offers, 
the algorithm reduces the speed of trading (panel I: self-damping property) 
and waited for a longer time to find better matching counterparties. In un¬ 
stable market conditions, are indicated with the higher level of self-damping, 
the trader should pay for final inventory to liquidate the whole position of 
initial shares. At this point, the best strategy is to accept offers in the limit 
order book to avoid to never face severity penalties at the end of period. If 
estimated parameters of markets might show that the higher chance of same 
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Trading Boundary for multi stopping time and with Poisson Arrival 
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Figure 8: Trading boundary condition for multi-Stopping time and with 
Poisson arrival 


types of orders’ occurrences (panel II: self-exciting property), algorithm re¬ 
duces the trading rate in the hope of getting better offers. The second column 
shows the related entries of the value function as a result of the implicit and 
explicit cost of trading. The results demonstrate that the second type of the 
market characteristics with the higher level of self-exciting property can be 
more profitable. 

Having a look on the graphs (figure 9) showing the optimal trading rate 
of different scenarios, one can conclude that there are more fluctuations in 
trading if the probability of arrival new offers is reduced. 

Our numerical results also show that the proportion of the gain of the 
liquidation model considerably depends on the specification of the price im¬ 
pact function. It indicates that market conditions have an effect on the final 
inventory level and causes a substantial dropping in the final wealth of the 
trader. An important aspect of the optimal strategies, which we have de- 
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Panel 1 
Self-damping 

Revenue 


10% 

25% 

Quantile 

50% 

75 % 

100% 

k = 0.6 

$50,067 

Trad'rate 

0.36 

6.17 

12.75 

19.28 

44.16 

a = —0.6 


Inven' level 

6205.45 

14980.97 

22618.06 

31680.03 

70000 

k = 0.2 

$50,352 

Trad'rate 

0.27 

5.69 

11.92 

19.09 

44.59 

Cl 

1 

o 


Inven’level 

6479.85 

15814.89 

23071.59 

31534.80 

70000 

k = 0.6 

$50,000 

Trad'rate 

0.13 

5.53 

11.36 

21.00 

40.38 

1 

o 


Inven'level 

4159.49 

14490.57 

20724.59 

30499.13 

70000 

Panel 11 
Self-exciting 

Revenue 


10% 

25 % 

Quantile 

50% 

75% 

100% 

k = 0.6 

$50,779 

Trad'rate 

0.59 

6.17 

12.54 

19.27 

43.20 

a = 0.1 


Inven'level 

3229.40 

14751.81 

22830.39 

30507.01 

70000 

k = 0.2 

$62,539 

Trad'rate 

0.03 

5.74 

13.16 

22.15 

48.74 

a = 0.1 


Inven'level 

1593.42 

11177.87 

18155.91 

31810.18 

70000 

k = 0.6 

$94,691 

Trad'rate 

0.34 

9.68 

16.12 

26.71 

72.67 

cr = 0.6 


Inven'level 

2153.13 

7580.03 

19473.28 

36405.45 

70000 


Tabic 1: Summary of the result of simulation the level of inventory and its 
corresponding optimal trading rate under different market conditions 


veloped, is to take into account the execution risk in an illiquid market i.e. 
inability to liquid shares at the given time. 

The main assumption of the majority of limit order models is to trade at 
best bid and ask prices (see: Cao et al. (2008), Battalio et ah (2014)). We 
allow the trading procedure go to deeper into the limit order book to avoid 
not filling the order and face last minute inventory penalties. 

8. Discussion and Further works 

In this paper, we proposed an analytical solution for the optimal liqui¬ 
dation problem with a dynamic approach and build numerical boundaries 
of multi-stopping problems in an illiquid market. We simulated the opti¬ 
mal splitting orders models according to the existing liquidity in the order 
book with different parameters and price impact models. We have used a 
Piecewise Deterministic Markov Decision Model (PDMD) to decompose the 
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Figure 9: Trading rate of liquidation Problem with different specification 


liquidation problem, as a continuous-time stochastic control problem, into 
discrete period problems and applied Markov decision rules to obtain the 
solution. We studied the uniqueness and existence of the optimal solution. 
We indicated that that the percentage gain of the liquidation model depends 
on the market conditions and specification of the price impact function. 

In direct opposition to majority the limit order models for liquidating 
market which only trading at best bid and ask prices, our model allows the 
trading to go deeper into limit order book to avoid not filling of the order 
and face last minute inventory punishment. 

We believe that an attractive extension of our work would be to study; 
Cartea and Jaimungal (2014) discussed sophisticated models to trade at mar¬ 
ket order and post limit order; Cartea et al. (2014a) found optimal combi¬ 
nations of market and limit orders with learning from market dynamics to 
trade in the direction of price fluctuations. 

Modeling the orders’ arrival flow with a Poisson process is quite robust ap¬ 
proach. Cartea et al. (2013) addressed several uncertainties about the arrival 
rate of orders, the risk of not filling with limit orders, and misspecihcation in 
the dynamics of the stock’s midprice, with the robust portfolio optimization 
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approach. Iyengar (2005) proposed a robust formulation which is systemat¬ 
ically alleviated the sensitivity of the Markovian policy on the uncertainty 
of transition probabilities. We would like to examine the robustness of our 
findings with relaxing some assumptions of the model. 
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9. Appendix 

Proof of Theorem 1. If the number of orders is a random variable with the 
Poisson distribution and the mean value A in a finite interval of length t. We 
consider the order with maximum price of N ( 0,t ) number of limit orders as: 

Y = ma X {5‘,...,5f M } 

We define F N(0 , t) (Y) 

f n( ;o,o(y) = P[(s 1 <Y)n(s 2 <Y)n,--- : s N <Y)} 

= F(Y) N(0,t) 

The generating function with distribution function F(St) is 

G,(F(y)) = E[F(y)' vM ] 


G t+dt (F(Y)) 


E[F(Y) N( °' t+dt) ] 
E[F(F) Ar( °’‘ )+Ar(i ’ t+dt) ] 
E[F(y) iV( 0 ’ t) E[F(y) JV(Mt) ] 
G t (F(y))(l - A dt + A dt.F(Y)) 


Gt.+ d t(F(Y)) - G t (F(Y)) 

dt 


= -A(l - F(Y))G t (F(Y)) 


J t ( G t(F(Y)) = —A(1 - F(Y))G t (F(Y)) 


|ln(G t (F(y)) = -A(l-F(y)) 


G t (F(Y)) = e~ M(1 ~ F(Y)) 
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With assumption of a L number of unexecuted orders at the time point 
s, (s <t), the generating function for the time interval (0, s ) is: 


G.(F( y)) = ^e" A (F(y) 0 ) + ^e-^Ffy) 1 ) 
+ ■■■ + ^e-\F{Y) L ) 


= e 


-xMF{Y)f , (XF(Y)Y 


0 ! 


1 ! 


(A F(Y)Y 

L\ 


Use Taylor series with remainder: 


(• 1 ) 

(• 2 ) 

(.3) 


Gs(F(Y)) = e-\ e YFY) _ (.4) 

For c G [0,1], /(c) = F(Y') l+1 & e cX . For the sake of simplicity, it is assumed 
that c = 0. 


Gt(F(Y)) = G s+{t _ s) 

= G s (F(Y))G t _ s (F(Y)) 


(.5) 

(. 6 ) 


From equations .1 and .4, the generating function of time interval ((t — s), t): 


Gt-s(F(Y)) 


e -A(l -F x (y)) 

e -Xl(l-F x (y))t-ln(e^-^F)] 


(• 7 ) 

(. 8 ) 


Consider the number of orders in the coming stopping time is a random 
variable with Poisson distribution and mean value At. From above generating 
function, we can define the probability that no order arrival in time interval 
(0,t) is said to have a Poisson distribution greater than Y : 

P(U = fc|JV< 0 -*> = L) = GllY 


\, = A[(l - F(Y)t - ln(e AF <''> - PUP)] 
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where F(Y) is the distribution of the price process and L is the number of 
unexecuted orders up to time point s. Where k — 0 , it gives the probability 
of the best order, k = 1 is the second the best order, etc. □ 


Proof of Lemma 2. It is assumed the limit orders arrival rate is a point pro¬ 
cess with intensity rate X t and we liquidate A 7 * at each stopping time: 
r = {0 < Ti < T 2 < ■ ■ ■ < T n < T} 


V(T,Q°) 


(when n —>• 00 )(t G r) 


supE^[I/(T,Q 0 )] 

7 £A 


sup E ti 9 [V' e rTl A 'y t Stl(T i <T)] 
i =1 

sup E t tq [ f e~ rt A 7 t S t dN t ] 
~/&A Jo 

sup E tg [ [ e~ rt A 'f t S t Xtdt\ 
~/&A Jo 


□ 

Proof of Proposition 3. Following SDE represents the impact of trading on 
the dynamics of the rate of orders’ arrival: 

dX t = (fi'Yt) ~ kX t )dt + crdN t (.9) 

In order to prove, we can move the first term of SDE to the left side, then 
multiply it by e Kt (see : Norberg (2004)) or alternatively we can define an 
initial guess for the solution of above SDE as follows: 

Xt = X 0 + A/(%)r(t - s))ds + a f e-^dN, (.10) 

Jo Jo 
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Verify by Ito’s lemma on e Kt X t 


e Kt X t 


ne Kt X t dt + e Kt dX t 
nX t dt + dX t 
d Xf 


e Kt / ( f(r s )e- K ^- s) )ds + e Kt a / e~ K{t ~ s) dN s (. 11) 

Jo Jo 

pt ft 

(. 12 ) 


/ (f^ s )e KS )ds + a / e KS dN s 
Jo Jo 

(/(7 t)e Kt )dt + ae Kt dN t 
(fht))dt + crdN t 
(fht) - kX t)dt + odN t 


(.13) 

(.14) 

(.15) 

(.16) 


□ 


Proof of Lemma 4- of a buy order (.10). 


lim D(t) 

t—yoo 


= lim / s))ds 


t—> OO 


= lim / (f( ls )e~ K ^)ds 


t—¥ OO 


lim e 

t—¥ OO 


— K,t 


(. f(ls)e KS )ds 


fo(f(^)e KS )ds 


lim 

7-00 


3 hzt 


(apply l’Hopital’s rule) = 


lim l /(7,)e '“ ) 


<-7oo KC 


Kt 


lim 

t—>oo 

lim 

t—>oo 


exp(a'f t ) 


K 


1 + ayt + 0(«7t) 1 + ct7 T 


= A, 


K 


K 


We defined the liquidation problem as a finite time investing problem on 
a limited time horizon T. Aoo represents the long run trading impact on 
the intensity of order arrivals rate, we can think of it as a permanent price 
impact as ’’base” intensity part of stochastic intensity. It is a linear function 
of trading rate to avoid dynamic arbitrage Gatheral (2010). We can express 
the permanently effected stochastic intensity by: 
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Af erm = Aoo + a [ e~ n{t - s) dN s (.17) 

Jo 

Instantaneous market impacts can be measured from the small interval 
of trading, and the difference between the pre-trade and post-trade price 
movements: 




lim D(t) = lim / - s))ds 


£—>-0 


£—^0 


f*t-\~£ 


= lim / (exp(a%)e K(< S ' > )ds ~ exp(—nt + « 7 e ) = A £ 


£—>-0 


We can simply define the instantaneously affected stochastic intensity by: 


A l nst = \ E +a / e- K{t ~ s) dN s 

Jo 


.18) 


□ 


Proof of Theorem 5. By using the information on the jump location from 
Z = (Z 1} Z 2 , ■ ■ ■, Z n ) as a set of post jump of PMDP , we have: 


rTi 


V n (t,q) = E t;9 [/ e rt A 'y t s t X t dt\ (ter) 


f Tl 

(refer to equation:6.3) = E t)a: [ / U n (XT/)dN t \ 

Jo 


N f T i+1 ATl 


i=0 


N rT i+1 ATl 

(Zi define as Z t = [Ti,X Ti ]) = ZT(0(X T .))d^ t |Z i ]] 


i= 0 
N 




i=0 


= V*(t,x) 
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We define a set II = { 77 ,7t 2 , • • •, ttn} as a sequence of all Markovian decision 
controls i q corresponding to the Markovian policy for the predictable admis¬ 
sible process 7 included in the set T. We can then decompose this optimal 
control problem into the piecewise-deterministic Markov process: 

V(t,q) = sup T(t,x) 

7tEI1 


□ 


Proof of Theorem 6. In the theorem 5, we have shown that 

V(t,q ) = sup H^it.q) 

7 

= sup d f7r (£,x) 
wen 


with dehning the sequence of II = { 77 , 7 r 2 , • - -, 7r n } as set of Markovian poli¬ 
cies (Bertsekas and Shreve (1996)), we have: 

T 77 ™ = lim T 770 ■ T 771 ■ T 772 ■ ■ ■ T 77 ”- 1 T 770 (x 0 ) 

n—>-+oo 

= lim (T 77 ")"^^)) 

n—>-+oo 

= T n (^(x 0 )) 


Therefore under the same condition, the optimal solution is defined as: 

T(x) = sup(T 7r (x)) 

7tGI1 


Equally 


T(x) = T(T(x)) 


which is a subset of the Banach space, so we can apply the Banach fixed 
point theorem and show that V is an unique fixed point of the operator 
on the set II. 
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